learning state-based behavior
A Case-Based Reasoning Approach to Learning State-Based Behavior
Gunaratne, Amrik Sacha Elapata (Carleton University, Ottawa) | Esfandiari, Babak (Carleton University, Ottawa) | Fawaz, Ali (Carleton University, Ottawa)
Learning from Observation involves creating agents that observe experts performing tasks and imitate them. Case-Based Reasoning (CBR) is a tool that can be used for this purpose. Regular CBR can only learn memoryless behavior: behavior that doesn't rely on the past. Temporal Backtracking (TB) is an approach to learning state-based behavior that uses recency as its inductive bias, which may or may not be relevant to the agent behavior. We show how TB can be viewed as a particular case of a more generalized case-based approach to learning state-based behavior that can accommodate other inductive biases. We then propose five alternative similarity metrics to learn three different state-based behaviors in a 2D vacuum cleaner domain, and compare their performance to the TB algorithm's performance. We show that none of the proposed metrics (nor TB) is a one-size-fits all algorithm for learning state-based behavior.